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[Article by Z. H, Luo and Y. Sakawa, Dept of Control Engineering, Faculty of 
Engineering Sciences, Osaka University] 


[Text] Abstract 
A space robot consists of two parts, namely a satellite base and a manipulator 


mounted on the base. Unlike the earth-mounted robots (EMR), any motion of the 
satellite-mounted manipulator (SMM) will cause the motion of the satellite base, 


and vice versa. Hence the motions of the two parts are highly coupled. Control 


of SMM thus becomes much more difficult than that of EMR, 


Longman etc.(1] discussed the kinematics and reaction moment compensat/on 
problems of SMM, Their techniques are essentially forward, or say, open loop 
scheme, Umetani and Yoshidal2 proposed the so-called "Generalized Jacobian 
Method (GJM)" to control SMM, This method strongly relies on both the 

linear and angular momentum conservations, Masutani etc, 14] and Tsuchiya and 
Yamadal5] used the idea of GJM And successfully realized sensor feedback con- 
trollers for the position and orientation control of SMM, 


All these works intended to generalize the well known results for EMR to the 

control of SMM. However, one should recognize that the space environment is 

quite different from the earth environment. For example, a satellite may be 

subject to very complex motions, In this case, GJM is not always applicable. 
Let us also point out that it is not an easy task to evaluate the generalized 
Jacobian. 


Keeping these in mind, we shall consider in this work the dynamics and control 
of the SMM with an active control of the satellite base. During the manipula- 
tion, the total external forces are assumed to be 0, but the torques are 
applied to change the angular momentum, hence only linear momentum conserva- 
tion holds, The problem is to capture a torque-free axisymmetric body, which 
is undergoing tumbling motion in space environment. A Lyapunov approach is 
applied to derive control torques which guarantee that the position and 
orientation of the manipulator hand will approach that of the body to be 
captured. To implement the proposed control law, we need essentially the 
information about the position and orientation of the object measured from 








the satellite base, the information of the orientation of the satellite base 
measured from the inertial coordinate system, and the information of the 
position and orientation of the object measured from the hand coordinate 
system. 


1. Introduction 


Beginning with the space station project by NASA, an age of space utilization 
is just about to start on a full scale. Space robots are expected to play a 
big role in the fields of assembling structures in space, maintenance and 
recovery of satellites, However, in comparison with earth-mounted robots 
(EMR) based on the ground, the base of satellite-mounted manipulators is more 
free to move at will causing it to be much more difficult to control robots 
in space. Our study here will describe dynamics of a robot and its control 
method in controlling actively and simultaneously the attitude of a satellite 
main unit and joint angles of its robot, 


2. Dynamic Model 


A space robot as shown in Fig. 1 is considered. 








4 Fig. 1 


In comparison with the mass and inertia of the tip hand, those of the robot 
arm are supposed to be negligible. 


Further, no external force is supposed to exert on the sate-lite unit itself 
but a rotational torque can be generated from GMG, etc., for controlling the 
satellite attitude, 


As the gravitational center of the satellite robot is not varied, the original 

point of the inertial coordinate system 2 is set at the system mass center and 

a coordinate system Ip is fixed to the sate-lite main unit, that would have its 
original point at the satellite main unit's mass center and have the satellite 

inertial main axes as its coordinate axes, Likewise, a coordinate system ¢ 

is supposed for the tip hand and Bre as the positional vector at Zp of the 

Lg original point and wb and Rg as the angular vector and rotational transform 

matrix of ig for t. 








When qa = (a, O95 a4)? is set as the Euler anguiar vector of the satellite main 
unit and w, = (4, @, w3)', as well as G=(Gij) and Q=(Qij) satisfy w, = G(a)a 
and @ = Q(4)uw,, the following results from the kinematics: 


Bp = £(0) (1) 


Here, 6 is the 6th dimensional rotational angular vector of the robot joints. 
Time differentiation (denoted 54) at Zp shows 


~Tis. re (2) 


Likewise, when By is supposed to be the angular speed vector of Cp for fp, 
the following is obtained, 


B 
We = Jy 9 (3) 


De ae is the Jacobian matrix itself of a ground robot. 


As no external force is exerted during operation of the robot arm, the 
momentum is conserved. Hence, 


MpP,, + MEP, = 0 (4) 
Here, Mp and Me are masses of the satellite main unit and tip load respectively. 
Ph and P, are the positional vectors of the original points of tg and fp in 


the inertial coordinate system ~ as shown in Fig, l, 


Obviously, 
Pe = Py, + RB>P, 


Hence, 
P, = Py +, x (Rp P.) + Rp 55 (5P,). (5) 
Further, from (2), (4) and (5), the following is established. 
(My + Mc)P, + Me Rg Jyngb + Me wy x (Ry P,) = 0 (6) 
When this is rewritten, the following results, 
P, = -kRgJyqh - ky ™ P, xJu, (7) 


Here, the symbol [*x] means the following equation when an optional 3 
dimensional vector a = [ax,ay,az]!. 


0 a, —@y 
ja x] = “Gs 0 a; 
Gy “Gs: 0 











Further, k= aig, CHS. 
Now, let's think about the system kinetic energy T, 


When the rotational matrix of tp for 2, is supposed to be R(6), the kinetic 
energy T is a sum of the translation (parallel progress) and rotational energy 
of the satellite main unit and hand, That is, 


ae lr , 
T = 5 MiP, P,+ 3 Ww), Rel, RE w, (8) 


... - 1 : 
+ g MeP. P,. + = ue R(6)I-R(0)7 B.. 


Here Ip and Ie are the inertial tensors of satellite main unit and hand 
respectively, Using the formulae of (3), (4) and (7), T can be rewritten 
into the following, 


T= <a Ha 


Here, q = [wp gty? and when q = fal, gly? H is the function of q. When H 


is divided into 2 x 2 blocks corresponding to q, the four blocks will be given 
in the following. 


Hy, =Rp|-Mo[° Pex]? + 1)R} 

Hyg =- MoRyl? Pe x|Jpe 

Hi, =MaJy{?Pex|RB 

Hy =MaJ iy Jyg + Jag R(O)1eR(O)! Jug 


4 above formulae, Mg = k2M, + (1-k2)M,. Further, a relation formula 
Inger eX] = Rel Bpox]RE is used, It is obvious that H is a symmetrical regular 
matrix, 


When the Lagrange formula is applied, the robot arm's kinetic formula will be 
as follows; 


YUllaad + Sita dismay + (EG, @))i = 75 (9) 


j=l j=l 


Here, T, is the drive torque of a joint i and c2(q, q) are the vectors having 
the following elements. 


9 3 | 
@i=d[D ten + > eng ala, 


j=l k=l d 2. 


Here, (H) means the jk element of H. 


Then the kinetic formula of the satellite main unit is introduced, The 
Lagrange formula related to the pseudo coordinate is given in the following 
manner, 
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i Bu; ia)* DO sengy, -LDeige = (10) 


Here, 


Cijk = » T(E sa Fo) uQei 


Summarizing the (9) and (10), the following kinetic formulae are obtained, 


Hy (Gho(t) + Hy2(@O(t) + 21,4) = # (11) 
Hay (@doy(t) + Ho9(@)O(t) + 209.4) = 7 (12) 


Here, cl is a vector having the following element, 


(c; “ a Deng -2. Qi 5 + (it Hila). 


Further, # = (#, #2, #3)’, r=(n,-:-,%)’ are respectively control torques of the 
satellite attitude and robot joints, 


3, Grasping Rotational Objects 


In this section, we will describe a control algorithm in grasping an object 
rotating inacomplicated manner with a robot arm, An object with its 
symmetrical axis is supposed to be in a tumbling movement without external 
force nor torque as shown in Fig. 2,13] 








It is also supposed that the angluar momentum vector h, and the longest main 
axis direction vector p3 of the object and the angular velocity vector w, (t) 
are always on a similar plane. The body cone rotates in contact with the 
space cone, 


The projections of wo(t) to hy and p3 are written as wp(t) and w(t). As ho 
is constant, it is detected first and shifted so that the mass cbnter of the 
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satellite robot system comes on the h. axis with the robot arm folded on the 
satellite main unit. Then, with no external force applied, the mass center of 
the satellite robot system at that time is set as the inertial coordinate 
system, When the robot is moved, the angular velocity and central position 

of the satellite main unit are also varied concurrently, but it is vital to 
give a satellite torque and a robot's joint torque so that the satellite main 
unit's angular velocity wp(t) agrees with wp, and the robot hand's angular 
velocity agrees with wp (t) respectively. The control rule for that purpose 

is shown below, 


Fig. 3 shows its conceptual operation diagram, 





Fig. 3 


The tip velocity of a robot arm in the inertial coordinate system is given in 
the following from the (5) and (7) formulae, 


P, =(1-k)[Rp BP, xjuy + (1 - k)RpJy96 
And, the angular velocity is given. 
we = wy + Rg Pw, =u, + Ry Jug 
When @=(P), wi)? , it is understood the following is satisfied. 
é& = Inu, + Jd 


Here, J2 and J@ are given in the following formulae, 


(1-k)Rpl?PexIRB) 5 (" — k)RpJye\' 
Jq= ( , = Rohe 


Then, a, = |?) w!|’ is supposed to be a combined vector of the velocity and 
angular yelocity at ~ of the object and e« be a vector with the position Ep 
and attitude angle FB, (Roll, Pitch, Yaw) combined, That is «= (®p/, Ett. 
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This can be measured if a camera is se~ to the hand. The purpose of control 
is to bring this e to a proximity of O and grasp the object. The control rule 
for that purpose is introduced in the following manner, 


The Lyapunov function for optional reguiar symmetry constant matrixes W and Kp 
are chosen as follows: 


V(e) = Bley — wn" @ — Jp bp ~ Jews) 


wy —Wh, 1 T 
; +-e'K 13 
(, - Jy ‘(#0 - al eed an 


Here, J6 is supposed to be always regular. 


By differentiating both sides of V(t) with time and using the dynamic equations 
of (11) and (12), the control input is determined as follows: 


(*) (0) -#*" (an) 
+ ry f(t) 
= FF Ww, — OW), 0 (14) 
-HE-'w {« ( Ab )s (starz) 


Then, it is known V(t) is non-positive. That is, 


V(t) = —(w, - wy)! Ku(wy , Wy) * ad’ K, ad <0 (15) 


However, in the formulae (14) and (15), the following is satisfied. 


f(t) = -Je"(&, - Jquy) - Jy (a, 


Ss ~ Jie), 
46 =6- Jp '(%, 


~ Jquy) 


And, E is the following matrix, 


ge. 4 
E= 
Lott :) 


Obyiously, an inyerse matrix E~| does exist, Kw and Ky are opt tonal 
symmetrical regular constant matrixes with K = block diag {Kw,Kv}, Further, 
A is set as follows; 


= — block diag {I, F-'(®8,)) 


Here, F(®g.) is a 3 x 3 transform matrix satisfying /("6,) (aPu, = F(&p,)",’, 

Ewp denotes an angular velocity of the object as seen in the hand coordinate 
system, It can be confirmed that F is regular in the proximity of 8, = 0. 
When the object is axially symmetric, w is constant, that is, w, = 0. 
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Then, let us check when V(t) is 0. In such a case, from the equation (15), 
the following is satisfied, 


w, = wy, 6 = Je "(ep — Jnwy) (16) 


When the error vector of position and attitude e is supposed to be not 0, 
it is known that [0, gia? x ejT = 0 by substituting the control torque formula 
(14) for the kinetic formulae (11) and (12) and taking (16) into account, 
This means ¢ = 0, Therefore, the closed loop has an asymptotic stability 
from the LaSalle theorem, Now, it should be noted that either of x 
in the (14) formula is an expression of the inertial coordinate systen, 
From Fig, 1, the following its established, 
‘ B 


And, the Bp is the positional vector of the object as viewed from the 
satellite main unit. By differentiating both sides of the formula (17) with 
time and using the formula (7), the following is obtained, 


P, = — kRpJyob — k[Rg OP, x}, 


+ [Rp PPyx}uy + Ry 8P, (18) 
In regard to woe the following equation is established, 
Wo(t) = wy + Rgrw, (t) (19) 


In this article, it is assumed that it is possible to measure by any means 
the attitude angle % and angular wageetty wp (t) of the satellite itself, as 
well as the position BPD, velocity Bp_ and angular velocity By, (t) of the 
object from the coordinate Re Therefore, W(t) is given in the formula 
(19) and w,(t) can be calculated from Wp = Wo - Wp, as shown in Fig. 2 and 
can be obtained from the formula (18). 


Further, it is assumed that x, can be obtained from a difference of xp. 
Hence, the control rule of the formula (14) can be realized. In summary 
of the foregoing, the physical quantities to be measured and calculated 
are as follows: 


(1) To detect angular momentum vector ho of the object, 
(2) To measure attitude angle (Euler angle) a and angular velocity wu 
of the satellite main unit, 
(3) To measure rotational angular velocity w(t) of the object {wp and 
Wp(t) are known from its result}. 
(4) m3 measure position 6(t) and velocity 6(t) of each joint of the robot, 
(5) To measure position BP. and velocity Bp, of the object as viewed from 
the satellite main unit, 
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(6) To measure the position and attitude e of a target from the robot hand 
coordinate system Ip. | 

(7) To calculate quantity Xp 
formula (18). 


(8) To calculate Bx, from  * using numerical differentiation. 


in the inertial coordinate system using the 


4, Conclusion 


We introduced here the dynamic kinetic formula of a space robot and proposed 
a control rule to grasp a complicated rotational body with the robot hand, 
It is possible to calculate the control torque by measuring the physical 
quantities such as positions, attitudes and velocities of the robot hand and 
grasping object as viewed from the satellite main unit, as well as the 
attitude angle, etc, of the satellite itself, 
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[Text] Abstract 


In the near future, it is expected that the space robots will perform the 
dexterous and complicated tasks required in the space activity, such as,truss 
assembly, ORU change out, retrieval of debris, etc, In order to perform 
these tasks, the manipulator control systems should have the ability to 
realize the motions composing the tasks, They are positioning, force 
generation, compliant motion, position/force hybrid motion, and so on, As 
the functions required to the control systems to realize these motions, 
following control criteria are chosen, 


(a) Load adaptive control 


In the space, due to the small gravity, the range of the mass of the loads 
handled by the manipulators is wider than that on the earth; accordingly, the 
response of the manipulators varies widely influencing the performance of 

the robot, The control parameters should be changed according to the loads. 


(b) Disturbance compensation control 


The base of the manipulators is not necessarily combined rigidly with the 
objects, So the external forces on the robots, or on the objects easily 
cause the relative motion between the robots and the objects which can be 
compensated by the relative position/velocity feedback. 


(c) Impedance control 


The purpose of the impedance control is to respond properly to the reaction 
force from the objects, when mating connectors, capturing the objects, or 
so, in order to avoid the overload on the contact point and to follow the 
movement of the object, 
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(d) Position/force hybrid control 


In many tasks, it is required to control position to some directions and to 
control force to other directions simultaneously, The examples are, mating 
connectors, fastening bolts, cleaning, etc. 


Most of the tasks are carried out by the combination of these controls. For 

example, when capturing the flying object, positioning control is done first 

before the manipulator touches the object, Next, impedance control with low 

stiffness is done to absorb the impact, followed by the tuning of the control 
parameters according to the load adaptation algorithm, 


The important thing is to carry out those functions at a time, This report 
presents the configuration of the control system which realizes above 4 
functions in cooperation with each other, 

1, Introduction 

Tasks required of robots in space are diversified - among them - replacement 
of instruments, maintenance and check, assembly of structures, but basically 
these works have to be performed by a single robot, 

In this paper, we will concentrate on the control technology of a manipulator 
most operative among space robots and describe what control functions are 
required and how the control system should be structured. 

2, Conceptual Diagram of a Space Work Manipulator Control System 


The manipulator control system configuration can be roughly categorized into 
the following three sections as shown in Fig. l. 


o Section for planning of space works 

o Section of deploying the arm in specific movement 

o Section for executing each operation 

It is reasonable to think several hands are required in space works and we 
will discuss here a control system configuration to execute each operation 
of each arm, 


3, Required Control Functions 


Control functions deemed important in executing each operation at will are 
shown below. 


(a) Load adaptive control 
In handling objects with various weights in space, the control parameters 


must be changed corresponding to each load so as not to vary the response 
characteristics but the load characteristics are seldom known in advance. 
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Pig. 1 Concept of Space Manipulator Control Sysice === CS 


Therefore, it is generally conceived to move a robot and identify its load from 
the response, 


(b) Disturbance compensation control 


In space works, the robot itself and work objects are often loosely connected 
and any external force might remove the objects from the robot, affecting the 
space works, To avoid such a mishap, a method is provided to detect a 
relative movement of the robot and objects, thereby correcting commands to the 
robot and cancelling tts movement due to disturbances. 


(c) Impedance control 


When the robot hand gets a reaction force from the work objects, it is con- 
ceived to give a proper response to such a reaction force and it is called 
the impedance control, [In space works, connectors may be misaligned and an 
impact may be generated in grasping a flying object and these misalignment 
and impact are absorbed or lessened with the impedance control. 


(d) Position/force hybrid control 
In many works, it often happens that the position in a direction must be 


controlled while the force tn another direction should be controlled, In 
space works, these controls are often needed in the following, 
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o Aligning connectors 
o Tightening bolts 
o Cleaning 


They are shown in Fig, 2 and functions mentioned in the above (a) to (d) are 
diagrammed in Fig, 3. 
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Fig. 3 Function Diagraa of Space Manipulator Control Systes 


4, Configuration of the Control System 


First, the impedance control and the position force hybrid control are 
compounded, It is impossible to control the position and force to any 
value simultaneously, Therefore, in the position control space, . normal 
impedance control is use’ and, in the force control space, force is taken 
as the control quantity to form as an impedance control space without con- 
trolling the position, (2) 
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In a space compounding the position control and impedance control, the 
required response is as follows: 


MaS¥ *DeS(¥-¥e) KeS(y-¥0) = SF (1) 


In a space compounding the force control and impedance control, the required 
response can be written as follows: 


Mo(E-S)¥*De(B-S) (5-44) =(B-S)(F-Fe) (2) 
Here, 
Md ; Required mass Kd : Required spring constant 
Dd ; Required damping S : Space switching matrix 
y : Arm position vd ; Arm target position 
F ; External force on arm end Fd ; Target force on arm end 
E :; Unit matrix 


Ween this formulae (1) and (2) are compounded ‘added), the following is 
established, 


Mey ‘Dal y-ya) Ka -ya) “F-CE-S) Pe 
¥'Da(¥-¥e) KaS(y-ye) -F-(E-S) (3) 


This formula (3) ts the target response of arm end, 


In the meanwhile, when it is supposed no static force its exerted, the robot 
arm movement can be described in the following formula, 


Wyth="J-'c oF (4) 
Here, 
M ; Generalized ine)'tial matrix t : Joint torque 
h ; Non-linear term of velocity J :; Jacobian matrix 


The required joint torque is obtained in the following by deleting y from 
the formulae (3) and (4). 


Tt =" J (ile **(heS(ye-v) Del¥e-$)) 
(Mile ”"-B)P-Mile” '(B-S)P eth) (5) 
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To this, by adding the parameter adjustment mechanism for fluctuations of 
relative position with the object, velocity loop and load for correcting 
disturbances, a control system satisfying the above (a) to (d) simultaneously 
is conceivable. Its block diagram is shown in Pig. 4, 
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5. Conclusion 


We showed tn block diagrams functions and their configurations required in 

the mantpulator control system of a space robot, What we suggested here is 
how to structure an entire control system and it requires specific discussions 
separately how to implement each control element, 


Part of this study has been commissioned by the National Space Development 
Agency of Japan, 
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[Text] Abstract 


A smart end effector that is attached at the tip of a large arm or on a free 
flying teleoperator to capture a drifting target object in space is developed, 
The mechanism consists of three linear actuators for positioning and three- 
dimensional gimbals mechanism for orientation, As the reduce of the problem 
originated by the uncertainty of the positioning of the large arm or the 
free-flying teleoperator was aimed at, this mechanism was chosen because of 
its compactness, controllability and the movement equality, The linear 
actuator consists of a DC brushless motor with a ball-screw driver that has 
good controllability and high stiffness. As this mechanism is unstable, 
three parallel mechanisms each of that consists of a spline and some bevel 
gears are attached to keep the platform of the gimbals parallel to the base- 
ment of the end effector, An approach and distance sensor enables the sensor- 
feed-back to a target marker, As it is rather easy to solve forward and 
inverse kinematics, the cycle time is shorter than l16mS which is the time 
interval to take in the position data of the target object from the approach 
and distance sensor. Some preliminary experiments to trace a target marker 
showed the good controllability. The qualification test shall be under- 
taken on a 2-Dimensional test bed that consists of a flat bed and an air 
bearing system which enables frictionless condition to simulate micro- 
gravity condition, 


1, Introduction 


The robotics technology is a must in the space development and a safe and 
rational new horizon can be exploited by relying on this technology in 
environment unfavorable to human in terms of vacuum and radio activity. 

In such an instance, a large crane-type manipulator arm or free-flying 
teleoperator is used in space operation and the relative velocity between a 
captor side and captive side drifting in the weightless condition of space 
should be held to the minimum, 
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A large arm and teleoperator do not necessarily have the optimum positioning 
control method for the tip of an end effector and it is not so easy to keep the 
relative position for the target, To solye this problem, compensation must be 
made with a degree of freedom as much as required by the end effector unit and 
local sensor feedback control loop, From this viewpoint, we have developed a 
target capturing device with flexible and adaptive capability and the following is 
our report on this development, 


2. Mechanism 


For the purpose of our study this time, we though ft better for the mechanism 
unit to have a high rigidity and compact shape with few singular points in 
case of the inverse kinematics, 


When it is controlled with a software servo, it is optimal to have topology 
allowing required position and velocity easily in a short operation time, 
From these requirements, we have adopted a mechanism of 3-axis parallel + 3- 
axis gimbals, However, we used a neck swing (oscillator) with one degree of 
freedom this time instead of gimbals as we are going to experiment mainly on 
a 2-dimensional test bed, 


The 3-axis parallel has no singular point in the operation range allowing it 
to obtain forward and inverse kinematics easily but is instable in structure 
and needs to incorporate a correction device somehow, For this, we used a 
combination of bevel gears and spline, Each axis of the parallel is a linear 
actuator activated by a DC brushless motor with a ball screw driver and it 
satisfies both high controllability and rigidity, Fig. 1 shows a photo of 
the end effector installed on the experimental 2-dimensional test bed, 
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Figure 1. The End Effector on 2-Dimensional Test Bed 
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3. System Configuration 


Fig, 2 shows a block diagram of the entire system, There are two CPUs each 
for the host side and control side, The host CPU is responsible for the man- 
machine interface mainly analyzing commands and processing data, For this 
purpose, we used a lap-top personal computer with Intel 80286, The control 
side CPU mainly controls the end effector seryo and to a lessor degree retrieves 
data, For this purpose, a lap-top personal computer with Intel 80386 is used 
as high processing is needed, Regarding the sensors for sensor feedback, an 
approach and distance sensor and force/torque sensor could be used, but at 
present only the first one is used, This sensor as reported earlier is 
capable of outputting the relative position and direction in video cycle to 
the target shown in Fig. 3, 


‘Actuators .- Actuator .- Control. -. Host... Human 
ee . ae CA! CA Operator 








|Approach Sensor .....— 





—4-¥ Table ' 











Figure 2. Sytem Block Diagram Figure 3. Target Marker 


A force/torque sensor with 6-axis output has already been incorporated and its 
software is now being implemented. 


4. Outline of Software 


The control cycle for the end effector has been matched with an output cycle 
of the approach and distance sensor, that is, 1/60 seconds, Commands are 
input from the host side keyboard and transferred to the controller side, 
The commands are basically classified into position controls, tracking con- 
trols and others, but an interpreter language combining them can also be 
used, This language is used in setting prelimiuary variables and for 
condition identification formulae, etc, 


A list of commands is shown in Table 1 and specifications of the interpreter 
language is in Table 2, 


5. Results of the Experiment 
Fig. 4 shows an example of the captor output in tracking a reciprocating 


target, There is a slight delay, but'it is assumed this can be corrected 
by adding a compensation element to the target velocity. Further, we have 
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labie 1. Command List 








item operatrion 
ad =s_—« Drive an actuator directly 
be Activate a brake of an actuator 
bo ‘Release a brake of an actuator 
ps Move to an orderd position 
t4 ~=Track a target with 
4-Dimensional senser-feed back 
control (x. y, Z, @ x) 
t3 Track a target with 
3-Dimensional senser-feed back 
control (x, y, @ x) 
sl Servo-lock whole actuators 
bi Brake-lock whole actuators 
br Brake-release whole actuators 
gc =—._-« Close _ a gripper 
go «©—-«da@pen a gripper 
ge Free a gripper 
sb Execute a submit file 
(Invoke the Interpreter) 
ss Dispaly and/or store 
senser data 
up Update a parameter table 
sp Set a maximum speed of 
the end effector 
rs _Reset the end effector 





Table 2. Specification of 


the Interpreter 





Variables 


Directives 


Command line Executable whole command 


in Table 1. 
Integer, 
50 variables maximum 
Def inition: 
$<name> 
Executable Operatations: 
addition 
subs ti tution 
VAR <variable> 
Define a variable 
GOTO <lable> 
Go to <label> 
PF aah 
ae ses 
ENDIF 
Conditional execution 
WHILE ... 
BREAK 
END 
Loop 
PAUSE 
Keep current state 
EXIT 
Exit from 
the Interpreter mode 





made an experiment of capturing the target in circle orbit using the 


_ interpreter language, which can be put to reasonable practice. 


At present, 


an experiment is being prepared to capture a free target with the language 
provided on the tip of an arm, simulating a large manipulator arm on the 


2-dimensional test bed, 


6. Conclusion 


This device has just been completed and its capability will be ascertained 
Further, we are considering to 


make the movement smoother after capturing the target, by conducting a 
feedback control with a force/torque sensor and verifying the possibility 


and supremacy of the active compliance control, 


by setting various parameters from now on, 
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[Text] Abstract 


This paper shows a recognition algorithm of a moving target using visual sensors, 
a manipulator control algorithm using recognized data, and capture experiments 
based on these algorithm. 


In order to develop an autonomous space robot, we constructed the ground 
simulation system where relative motion between the space robot and the 
target in zero gravity environment is simulated by combining a computer 
simulation and 6 axis servo mechanism, As operating thie system, experiments 
of autonomous capture of the target are performed. 


As 4 infrared light emitting diode (LED) are attached on the target and the 
image is taken in by 2 CCD cameras through infrared-through filter, light 
points are easily extracted, From the information of LED points, the target 
position and attitude are calculated by the use of sxtended Kalman filter 
including the equation of motion of the target, This filter estimates 12 
states; position, attitude, linear velocity, and angular velocity. As this 
filter has redundancy in the observation, it can be adapted to the case that 
some points are occluded, In order to correct the estimation errors due to 
the misalignment, a LED is attached to the hand and the hand position is 
calculated by the visual sensors and by joint encoders, These calculation 
cycle is about 450-500[msec], The manipulator is about 1[m] long and it has 
8 joints including the end effector, The trajectory is generated so as that 
tne hand approaches the target in a straight line from the present position. 
With respect to the attitude, the attitude of hand approaches that of the 
target at the constant rate. The trajectory is corrected every time when the 
states of the filter are updated, 


Based on these algorithm, we perform autonomous capture experiments of the 
target which moves in 6 D,.O.F. under the condition that the relative 
motion between the target and the space robot in zero grevity space is 


28 











simulated, As a result, it is confirmed that the space robot can catch the 
target automatically even if they are floating in zero gravity environment. 


1, Introduction 


We are developing a self-regulating mobile robot shown in Fig. 1. For this 
purpose, we have developed a simulator device (Fig, 2), simulating a relative 
movement in weightless space as a tool. By activating this device and 
simulating a weightless space, we have experimented a capturing of a target 
satellite (TS) with a slow motion of 6 degree freedom using video information 
only, The following is a description of the TS recognition algorithm and 

the manipulator control method used in this experiment, 
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Fig.1. Space Robot Fig.2. Outlook of the Simulation System 


2. TS Recognition Using Visual Information 


Based on the TS recognition using an extended Kalman filter (EKF), we have 
achieved a recognition with practical accuracy level by correcting the 
filter output through detecting the position of the manipulator from video 
images, 


2.1 Structure of the visual system 

The visual system has a structure as shown in Fig. 3. 

An infrared light emitting diode (IRLED) is attached each one on the four TS 
faces, its light point is easily picked up by inputting it through the 


infrared-through filter of two CCD cameras, The image recognition process- 
ing is made using this light point information only. 
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Fig.3. Image Coordinate System 


2,2 Recognition using EKF 


To recognize TS from visual information, we adopted an EKF, The EKF does 
not include TS dynamics, although it does include dynamics of the robot 
itself, errors are generated from a manipulator moyement which are caused in 
the satellite movement, However, these errors are modified by processing 
images at a high speed, 


The status vector estimated by EKF is as follows; 
v =v. IT 
x =[rp,P,t,P) (1) 


Here, rv and P is respectively a set of the TS's gravitational position 
vector and Euler angle as viewed from the visual coordinate system. The ° 
denotes a time differentiation. The observation vector is assumed as 
follows: 


z= [-- +, Zhis Ylir** sPrjstn T (2) 


Here, the (x14,y14) and (x,4,y > are respectively the light point 
coordinate picked up from the left and right cameras, Usually, four IRLED 
images are picked up and 16 of z elements are available but they are in- 
creased or decreased depending on appearance or disappearance of the light 
points, 


A dynamics model of TS has a translation (parallel progress:isokinetic linear) 
motion and rotation (nutation) motion, That is, the following is satisfied. 


To k+I = Tok + a ° At, rok+l = ar , 
Pett = Pe+ Pegi * At, Press = func(px, pe) (3) 
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Here, At is a calculation cycle time of the filter and the affix k is a time 
quantatized with At and the func() is a non-linear function including calculation 
of the Euler formula, Summing them up, the following is expressed. 


Xk+1 = £(xx) (4) 


Then, in regards to observation, the Z, which is a set of light point 
coordinates in the images can be expressed in the following using a non- 
linear function h regarding X,, 


zy = h(xs) (5) 


From the above, the EKF is structured in the following manner. 


Xn+1 = £(Xx) 
XK, = X& + Ki {z, — h(X,)} (6) 


K, = P,H7W-', P, = (M;' + H7 W-'H,)” 
M, = FP,-,F? +U, F= (4), H= (2) 
Here, the X, is a predicted value of X, and X, is an estimated value of X,. 


The U and W are error covariances of observation and dynamics respectively, 
and the following is satisfied when u and y are constants, 


W =w<iiexie, U = u-liaxia 


In actual calculation, the calculation quantity ts comparatively little as 
Fk, U, W and Hy, are often 0. Depending on the number of light points, the 
calculation cycle time was about 450 to 500 msec (including the processing 
in 2,3) using the MC68020/68881 (16 MHz). 


2.3 Correction using a light source at the hand tip 


Estimation using the EKF is unable to correct errors in manufacturing and 
initial settings fully. So, we have tried to minimize errors of the position 
which cause troubles in capturing the target by attaching a light emitting 
diode at the hand tip, As shown in Fig. 4, a position error of e is generated 
in the hand when an error e exists between the original point 0, of the 
manipulator coordinate system and the original point O, of the image coordinate 
system and the control command value is set at the following using the hand 
position vector rh calculated from a joint angle of the manipulator, 


mer. (7) 
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Therefore, Th is obtained using the LED on the hand tip and the error e is 


corrected using the following command value, 
Fee tem ry + (rf — rf) (8) 


In the formula (8), the attitude error between the two coordinate systems is 
disregarded. This much of an attitude error does not pose an obstacle in 
capturing the TS, Im Fig. 4, only the position error correction of the 
coordinate original point was explained as an example, but a correction of the 
joint angle can also be made in the same manner, 





Manipulator 





‘Target 





Um : manipulator coordinate system 
Ly : image coordinate system 


Fig.4. Compensation of Position 


3, Trajectory Control of the Manipulator With Visual Information 


In regards to the hand position, approach to the TS is in the sequence of the 
initial position 0 + A+ B+ C as shown in Fig, 5. 








Fig.5. Trajectry of the Manipulator 


32 








In the process of 0 + A +B, information obtained from the EKF is used only 
in approach, and correction is made at the point B using the method described 
in 2,3, 


In the process B + C, the correction value is fixed and this value is added 

to the EKF output for control, At the last point of C, the compliance control 
is made using a force/torque sensor at the hand tip to capture the target by 
absorbing the estimated error of the visual system. For a trajectory toward 
the command value, the current hand position rp, and target value (e.g., rq, 
etc,) are connected with a straight line and a command proceeding at a constant 
epeed on the line given. As an estimated value of the TS gravitational point 

rg is sent from the visual system every 0.5 (approx,) seconds, the trajectory 
is modified each time the value is sent, 
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Fig.7. Estimation Error of ¢ 


The attitude trajectory is modified likewise but its control is set to be 
insensitive to the rotation around the axis of the TS capturing rod as the rod 
is related to the axis, 


In the tracking control to the set trajectory, the position and attitude errors 
of the hand tip are fed back to the angular velocity of each joint using the 
Yacobian matrix,[2] 


In the control rule of this manipulator, an influence of the robot movement in 
reaction to the manipulator is not considered, However, it was possible to 
capture the TS by modifying the trajectory continuously from the images when 
the TS movement velocity is low, 


4, Experiments 

We have conducted experiments to verify the EKF property and to ascertain 
if the manipulator can be controlled accurately by the image informaticn, 
For the experimental instruments, refer to the reference material,|1] 


4,1 Recognition experiment of the movement using EKF 


We have tried to recognize TS in nutation movement about 120 m away from the 
camera, We set the angular momentum vector in the z axis direction and the 
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angle at 20°, between the angular momentum vector and the TS's maximum inertial 
main axis, The spin and nutation rates were set to be about 3 rpm. The 

initial values of the position and attitude were from values from a triagonometrical 
survey and the speed was set at 0. For the EKF, 12 variables shown in the 

formula (1) are estimated and one of their examples is shown in Fig. 6 and 7: 

an estimated value of $ (time differentiation of the Euler angle around the 

x axis) and its error, It is known that it is converged after about 10 seconds 

and estimation is made stable since then, After the conyergence, a steady error 
still remains but this is due to an error of initial settings, etc. in the 

visual system, 
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4,2 Capturing experiment 


We have conducted capturing experiment with varied parameters. Its results 
will be introduced in videos. In the experiment, we could move the hand 
almost accurately to a position of the TS capturing rod and track down the 
rod with the hand, Further, by adding the compliance control, the capturing 
rod was held without giving an unnatural force to the hand tip. There were 
variances in some cases but correction was made about 1 to 3 cm using the 
light source attached to the hand. 


5. Conclusion 


We have proposed here a TS recognition method using visual information, a 
manipulator control method based on its information obtained from processing 
the recognition, and have conducted an experiment of capturing the target in a 
state simulating a relative motion in the weightless space on a simulator 
device. As a result, we have verified that it is possible to capture TS 
steadily, even in a state of floating in weightless condition using these 
methods, 


From now on, we are going to check various other recognition and control 
methods and, while evaluating them using simulation devices, improve 
capability of the devices to cover more simulation cases. In conclusion, 

we would like to thank Mr, Katsuhiko Yamada for his advice in the processing 
algorithm and Messrs, Yoshigi Yabuuchi and Kazuhiko Pukushima for their 
cooperation in designing and manufacturing the experiment devices - all from 
Mitsubishi Electric Corporation. 
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[Text] Abstract 


The needs for the space robot systems are increasing all over the world, They 
are expected to support platforms or space factories deployed in the space 
infrastructure based on the Space Station Freedom around the turn of the 
century, 


The study on the functional allocation of robot systems is important, because 
many kinds of systems in orbit involving the space robots may be considered. 


In this report, the mission analyses, the system studies and the study on the 
functional allocation were carried out on the space systems in orbit involving 
the space robots, sponsored by the National Space Development agency of Japan. 


Missions of space robots were extracted every space crafts which will be 
necessary for space infrastructure from 2000 to 2010, The intensity of necessity, 
the year and the frequency of every extracted missions were discussed, 


Categorization of space systems was performed using 5 criteria such as moving 
ability, working environment, ability to perform plural missions, autonomous 
level and ability to carry massive objects, And 56 configurations of space 
systems were considered by means of the extracted characteristics of space 
systems belong to each of the categories, 


The study on the functional allocation of the space systems were performed 
to minimize the cost per performance in space development, and a proposal how 
to develop the space robots was offered, 


1, Introduction 
The need for orbital robot systems is mounting worldwide as the support 


equipment to operate effectively and safely the space infrastructure, 
This infrastructure includes space factories and various platforms to be 
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deployed from the sezond half of 1990s with the space station Freedom as the core. 


Missions to be performed by these orbital robot systems are varied and diversi- 
fied and orbital robot systems for each mission need to have various configura- 
tions, Therefore, in deciding what kind of an orbital robot system should be 
developed, it is important to calrify the following points. 


(1) What the robot system in orbit should do? (Discussion on missions) 


(2) What kind of a configuration should be possible for the robot system 
in orbit? (Discussion on system candidate) 


(3) What should be done by what system? (Discussion on functional 
distribution) 


This paper will report an outline of the above discussions conducted in the 
"Study (No 2) of the Space Robot Technology" commissioned by the National 
Space Development Agency of Japan, 


2. Discussion on Missions 
2.1 Setting of a spacecraft for mission services 


The space station Freedom will be launched for service in the second half of 
the 1990s, The period when orbital robot systems will be put to practice is 
assumed to be around 2000 and their service life is expected to be 10 years. 
A representative spacecraft served by orbital robot systems needed in 2000 to 
2010 is picked up from the space infrastructure as the prerequisite for the 
discussion here, (Table 1), 


Table... Assumed Spacecrafts Served by Space Kobot Systems Table.2 The missions of space robot systens 

























































































gerved ration Robot Mission ° NIFTY 
pacecraft are ng Typical Mission * Experinent/Production etc. TQ) 
Ti) * Replacement of ORUs C1O!IO 
ATP 2000 | Space Experiment, Observation . 
COP 2.0.06 | Seai-Conductor Production Rely of SesiMeaterisle 191010 
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1 | Not Des be served by Robot Dit * Towing (COP only) 

Convent ions Broken’ ieteti {tes nay be tunb | it sind ae : 4 
Debris nereas orbit by human space activit : 
Hote) ATE Ape) leat ion jecteology Platform Note) N (Nesessity)© : Nesessary, © : Maybe Nesessary 

MSPF ‘Manned Service Platfora F (frequency) : Alvaysy © : Sonstines. 

Rare, @ : Conti ingent 


JPOP: Japanese Polar Orbiting Platform 

GPF :Geostationary Platfora Y (year) : 2000~ 2005, 

GEOP :Geostationary Earth Observation Platfora Q : 08 done: oe x :2010~ 
F :Space Station Fr 
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2.2 Picking up and streamlining of the missions 


Missions of an orbital robot system for each service picked up in the above 
2,1 are listed and we have streamlined the missions from three viewpoints - 
required degree, work frequency and required time, 


As an example, missions for the co-orbiting platform (ATP,COP) are shown in 
Table 2, 


3, Discussion on System 
3,1 Categroization of orbital systems 


Various systems with operational functions are categorized based on the 
following yardsticks, (Features of orbital systems in each category are 
picked up.) 


(1) Shifting function: 3 ways 
[Shifting in space/primary and secondary shifting/Fixatton] 


(2) Self-regulating level: 3 ways 
[Near distance remote control (or steering)/remote distance remote 
control (or partly self-regulating)/self-regulating (or automation) ] 


(3) Generalization level: 2 ways 
[Exclusive/general1] 


(4) Work enyironment; 2 ways 
[Exposed environment/Pressurized environment] 


(5) Carriable weight; 3 ways 
[Small (“600 kg)/middle (600 kg ~5 tons)/large (5 tons~)] 


Each system in orbit will be classified into 108 (3 x 3 x 2 x 2 x 3) 
categories in total, 


3.2 Discussion on orbital system candidates 


From among the 108 categories, some viable ones are picked up and from among 
the orbital systems belonging to each category, representative ones which seemed 
necessary by 2010 were selected, 


4. Discussion on Functional Distribution among Orbital Robot Systems 


Based on studies regarding the technical level that may become necessary for 
each orbital system, the basic policy was set and there was discussion on the 
functional distribution, There are many systems capable of carrying out each 
work, For example, services such as replace and supply on the co-orbiting 
platform (COP) are possible either by an orbital service vehicle (OSV), which 
is a space shifting type general-purpose robot system or by a general-purpose 
(fixed type or truss shifting type) manipulator on the co-orbiting platform. 
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Carrying works on the co-orbiting platform are possible either by an orbital 
service vehicle which is a general-purpose robot system or by a HOPE STS 
(space shuttle) which is a dedicated transportation system, 


As to the policy of the functional distribution among systems, there are two 
main ideas - functions intensive method and functions distributed methods, 
The following is an advantage and disadvantage of each method, 


(1) Functions intensive method 


It is a method to concentrate as many functions as possible in a system, For 
example, it is possible to concentrate functions in an orbital service vehicle 
which is a space shifting type general-purpose robot, 


The advantage of this functions intensive method is its dispensing with 
robot systems (dedicated/general) in many services, once a single high- 
function general~purpose robot system is available, Its disadvantage is a 
high technical level requirement for the high-function general-purpose robot 
system and a possibility of critical damages when the system fails, 


(2) Functions distributed method 


This is a method to distribute functions to many systems, For example, each 
servicing platform has its own general-purpose manipulator system and services 
(replacement, supply, etc.), made by itself, The advantage of this functions 
distributed method is to localize a system failure without affecting the 
entire system and each system does not need so much high technical level, 


Its disadvantage is a requirement of many systems (dedicated/general), 


The function distribution among systems can be summarized as in the foregoing 
ideas but, from a viewpoint of maximizing the cost-performance in space 
development, the optimum solution may be found midway between these methods, 


Therefore, it will be important more than ever to come up with a rational role 
sharing between many dedicated and general-purpose systems, 


5. Role Sharing of General-purpose and Dedicated Robot Systems (Examples) 


We would like to introduce a replacement work of the mission payload in the 
JEM (Japanese Experiment Module) exposure section to be attached to the space 
station Freedom, now under development, as an example of the role sharing 
between general-purpose robot system and dedicated system, 


The replacement work of the mission payload in the JEM exposure section is 
exercised in a cooperative work between the JEMRMS which is a manipulator 
of near-distance remote control type with 6-degree of freedom and the equip- 
ment exchange unit (EEI') yt1] which is a dedicated system with l-degree of 
freedom (Fig. 1), 


The JEMRMS is mainly engaged in carrying the mission payload and in rough 
positioning. 
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E F U (Exposed Facility Unit) P I U(Payload Interface Unit) 
Fig. 1 EQUIPMENT EXCHANGE UNIT (EEU) CONCEPT 














The equipment exchange unit is mainly dedicated to attaching and removing 

the mission payload to and from the exposure section structure. The following 
functions, not avatlable with the JEMRMS, are realized with its light and 
compact unit, 


(1) Tracking down and aligning functions in correcting an error of the JEMRMS 
positioning, 


(2) Coupling and separation functions between the mission payload and the 
exposure section structure, 


(3) Batched attaching and detaching functions of the interface elements such 
as the fluid couplers, electrical connectors, etc, 


6, Conclusion 


As symbolized in the space station project, it is now difficult to conduct a 
space development which needs a massive development investment by a single 
country and global role sharing is becoming more necessary toward the 21st 
century , 
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Among such roles, orbital robot systems which are being recognized signi- 
ficantly by nations all over the world are a field where Japan is comparatively 
good at making the most of her robotics technology on the ground, Positive 
promotion of this field is hoped for. The work missions in orbit are very 
diversified and extensive and, for an orbital system to implement them, a 
variety of its configurations are possible from a general-purpose high- 
function robot system to a light and compact dedicated system, 


The vigorous function allocation among systems requires a re-examination when 
served missions, contents, technical levels required for each system, failure 
probabilities, etc, are clarified, 


In developing the orbital robot systems from now on, it is considered necesSary 
for Japan to study not only general-purpose high-function robot systems, but 
also various dedicated systems in parallel from a viewpoint of the maximum 

cost performance in space development. We would like to thank the National 
Aeronautics Development Agency of Japan who guided us in this discussion. 
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[Text] Abstract 


In the near future, it will be important to develop space robotic systems for assembly tasks, inspections 
and maintenance. work. As the first step in developing autonomous space robotic systems, a 
teleoperating assembly system for use in the space environment has been developed. 

In this system, a new target mark is proposed to guide the object easily by a human operator using a 
manipulator. In addition. a real-time simulator is used with every operation, so that the operator can 
easily understand the assembly environment and avoid obstacles without an actual manipulator motion. 
In order to verify this teleoperating system effectiveness, assembly experiments were carried out using 
an assembly type lager-scale space antenna. Results indicated that it was possible for an operator to 
assemble the antenna easily using the system. The experiments proved that the positioning accuracy 
using this target mark was sufficient for this antenna assembly. 

The system is composed of a teleoperating console, a real-time simulator, a robotic manipulator, a 
robot controller, a target mark and a CCD camera. A new three-dimensional target mark, which is 
attached to the target object. is used to measure the object position along six-degrees of freedom 
directions. Positional differences can be detected by an operator with the target mark image change. 
The operator controls the manipulator using a teleoperating console, so that the current target mark 
image matches the reference target mark image, which corresponds to the final target position. This 
teleoperating console has an image processor to extract mark image features. 

A real-time simulator was used to check both the manipulator motion and collision with obstacles. The 
simulator shows the manipulator motion, using the desired position data from the console. After the 
operator checks the manipulator motion, a motion command is sent to the robot controller. This 
simulator can also be used for off-line trajectory planning or making teaching data. 

The positioning accuracy using the target mark was investigated experimentally. The image processor 
extracted position information from binary mark images. The mark position data, when the image was 
acquired, was recorded and the displacement between the mark position and the reference position was 
calculated. Using these data, the accuracy for positioning error detection was measured. The 
experimental results show that the positioning accuracy using this mark is sufficient for general 
assembly tasks. 

The authors have also developed a new sensor integrated space antenna for assembly experiment use. 
This space antenna consists of an antenna body and eight sepagate antenna segments. The antenna 
body is equipped with a connection mechanism, the CCD camera and a light source. Each separate 
antenna segment has a target mark. Connection mechanisms were developed to make assembly simple. 

The antenna assembly experiments were carried out and experimental results proved that the visual 

information from the mark image made the antenna assembly operation easy. Also the results showed 
that the simulator was useful for both checking human operation error and helping the operator to 
understand the environment. 

Though the effectiveness of this system was verified, some problems, such as automatic obstacles 
avoidance, the vibration problem in space structures and applying a compliance control method, still 
remain unsolved. Now the authors are making efforts to improve positioning accuracy using visual 
information and to add intelligence to the assembly system. 
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1, Introduction 


In this paper, we have supposed an assembly work in space as the basic 
discussion of a robot system performing assembly, check and repair required 
on a space station, and developed a remote control robot system using visual 
information, The system validity was verified by evaluating the positioning 
accuracy with the visual image processing, and applying an assembly of the 
parabola antenna for space, 


2. Remote Control System 


This system is an experimental system on the ground, which is supposed to do 
an assembly operation in space by an operator with a remote control of multi- 
joint arm, It is excellent in extendability and has the following features, 


o Guiding for positioning with 6 degrees of freedom with mark images 

o Automated extraction of the mark feature quantity with the image processing 
a Display of the work state in real-time simulation 

o Operation check and off-line teaching functions 


The remote control is conducted by observing a new cubic mark set at the 
segment facing the operation, and aligning the mark image shape to the 
reference image extracted from the mark image features after assembly, 


Once a real-time arm operation and position relationship among operation 
objects are displayed in simulation, and their operations are ascertained then 
the arm operation is conducted. With the above methods, the operator is 
allowed to watch the mark image and simulation display to complete the 
assembly operation by positioning guidance of 6-degree freedom without 
supervising the real arm operation, 


An example of the system configuration is shown in Fig. 1 when this system is 
applied to an antenna assembly operation. 


A cubic mark is set at the separate antenna segment that is to be operated and, 
with the CCD camera set on the antenna body, the mark image can be picked up, 
The remote control console is capable of a superimposed display of the 
mark's camera image and the reference image on its CRT. Therefore, while 
watching the display, the remote control is possible using a joystick or the 
like, Further, its features include extraction of features of a mark, and 
image processing functions, such as the positioning attitude measurement, 
The real-time simulator is linked with the remote control console connected 
by GRIB and displays in real-time, a simulation of the assembly operation. 
It is also possible to display from any optional direction based on the 
viewpoint data, Furthermore, it has off-line orbital planning and teaching 
functions, For calculation, DSPI1] is used for the high-speed real-time 
operation processing. For the arm, a 6-degree freedom vertical multi-joint 
type is used, 
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3. Positioning Mark 
3.1 Features of the mark 


The largest feature of this system is to guide positioning using a three- 
dimensional positioning mark, This mark has the following features, 


o Easy to use detection for 6-degree freedom positioning and attitude errors 
o Easy to understand features of a mark and simple image processing 


o With its dented shape, it is possible to be set to the joining face of an 
assembly target, 


As to the method for detecting a positioning error, we would like to explain 
an example using features of a mark shown in Fig, 2 and binary images of an 
actual mark shown in Fig, 3, 


Fig, 3 (a) is a case when a mark is on the reference position, It is 
observed that, starting from the mark center in sequence, a concentric circle 
ig formed by a central circle with a cross, mid ring with a notch and circum- 
ference ring at the outside, 


This is because the mark has a structure mortised in a concentric circle 
from the observation direction, Fig. 3 (b) shows when a parallel progress 
(translation) displacement is given in the z-axis direction, With a mark 
center position (MCXO,MCYO) on the reference position as a center, and the 
outer ring of MDO in diameter is superimposed as the reference image, the 
mark diameter has a difference (MD-MDO) though the shape is similar, making it 
possible to estimate a displacement in the Z-axis direction, Fig. 3 (c) isa 
case when a rotation displacement is given around the X-axis further, When 
the center (mcx,mcy) of the central circle and the center position (MCX,MCY) 
of the circumference ring are noticed, a dislocation dcy (mcy-MCY) is caused 
and this change is used as a reference to estimate the rotation quantity, 
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Fig. 3 (d) is a case when a parallel progress displacement is given to 

Fig. 3 (c) in the Y-axis direction, this can be estimated from a difference 
dCY (MCY-MCYO) caused between the center position (MCX,MCY) of the outer ring 
and the center position (MCX0,MCYO) of the reference image, The Y-axis 
direction is estimated likewise and a change of the notch of the mid ring 

is used as a reference around the Z-axis and it is known that position errors 
in 6 free degrees in total can be detected, Further, in a general case when 
these displacements are combined, it is possible to detect a position error 
through proper procedure. 
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(c)Rotation around X-axis (d)Displacement along Y-axis 
Fig.3 Binary mark images 


3,2 Evaluation experiment of a position error detection accuracy 


By extracting features of the mark described in the foregoing section through 
image processing, we have conducted a quantitative evaluation of position error 
detection accuracy, 


For measurement, a mark of 50 mm in diameter and 40 mm in depth was used, We 
extracted feature quantities of mark images when a displacement is given to 
each degree of freedom with an arm remote control, The resolution of the 
processed images was 512 x 480 pixel, Position data for each image were 
recorded and a displacement quantity was calculated from the reference position, 
Above results were coordinated into a relation between displacements and mark 
features, part of which is shown in Fig, 4, 


Fig. 4 (a) shows a change of the difference (dCX) between the center of the 
mark's outer ring and the center position of the reference image when a 
translation displacement is given only to the X-axis direction at a point 
dZ = 78,7 mn, 
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(a) Relation between dX and dCX 
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(b) Relation between d @ and dcx 


Fig.4 Experimental results 


Fig 4, (b) shows a change of the difference (dcx) between the mark's center 
circle and the center position of the mark's outer ring when a rotation 
displacement dd is given around the X-axis at a point dZ = 57,7 m. In 

both cases, a feature quantity for each given displacement is given in a 
straight line passing through the original point and a similar result was 
obtained for the Y-axis direction, It is also possible to estimate a position 
attitude for the Z-axis direction using features that a mark's diameter MD and 
distance dZ are in reverse proportion, 


Measured accuracies in the proximity of dZ = 60 mm were as follows: 


Along X and Y axes ; + 0.3 mm/pixel 


Along X axis 


+ 1,3 mm/pixel 

Around X and Y axes : + 0,5° /pixel 
Therefore, we could detect position errors with very high accuracy, 
4, Antenna Assembling Experiment 


4,1 Assembly-type antenna 


This system was used for an antenna assembling experiment testing for the 
effectiveness of the system, which was verified, 
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The assembly-type antenna used for this assembling experiment had a diameter 
of 2 meters with one central mirror and eight divided mirrors, Fig. 5 shows 
a junction plane of the central mirror and eight divided morrors., To make 
the assembly work easier, a latch mechanism and a positioning guide mechanism 
(boss, cone guide) are set up as the aseembling mechanism, A CCD camera, 
ring light and mirror were set up as the optical untts for guidance with 
mark images, Further, a compliance mechanism utilizing a spring was provided 
to the antenna holding section to absorb a position error due to the guide 
mechanism, With the CCD camera and ring light set inside the central mirror, 
images were picked up through the mirror and lighting was made possible. 
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Fig.5 Configuration of the space antenna 


4.2 Results of the assembling experiment 


Using the real-time simulator first, the teaching data were made off line 
and, based on these data, the divided mirrors were held and the arm was 
shifted within the field of view. In the field of view, the assembling 
experiment was conducted with remote control at a point about 20 cm away 
from the junction plane of the central mirror, 


Fig. 6 shows a display example of real-time simulation and Fig. 7 shows its 
experiment sytem, As a result of the experiment, it was confirmed that the 
assembly completion guidance can be conducted favorably using the mark 

images, The real-time simulation was useful and effective in grasping an 
operation state and ayoiding collision and breakdown of objects due to an 

error of the operator, Further, after guiding the mark with a specified 

range, it was confirmed that an assembly can be exercised easily by guiding only 
to the vertical direction facing the junction plane, The guidance and 
compliance mechanisms were effective, 


5, Tasks to be Settled 
We are studying a partly-self-regulating assembly, an assembling experiment 


considering the vibration problem in space and an assembling experiment applying 
the active compliance control, 
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